Accessibility aids for users of electronic devices

ABSTRACT

A simplified UI mode is provided for computing devices, where complex user interface elements are replaced with simpler ones. In one embodiment, content, functions, and/or other selectable items on the home screen or panel(s) of the device are assembled into a one-dimensional list. In some cases, the simplified UI mode can be configured to receive a parsing gesture (e.g., downward drag gesture or a three-finger tap) that causes an item of the list to be aurally presented to the user, and a selection gesture (e.g., release of the drag gesture or a two-finger tap) to select the last aurally presented item. The simplified UI mode may be used in conjunction with a screen protector configured with tactile aid(s) configured to facilitate use of the device by a vision-impaired user. In one case, one of the tactile aids of the screen protector indicates how to activate the simplified user interface mode.

RELATED APPLICATION

This application claims the benefit of U.S. Provisional Application Nos.61/689,510 and 61/689,511, both filed on Jun. 7, 2012. In addition, thisapplication is related to U.S. application Ser. No. 13/912,976 filedJun. 7, 2013 and titled “Accessibility Aids for Users of ElectronicDevices.” Each of these applications is herein incorporated by referencein its entirety.

FIELD OF THE DISCLOSURE

This disclosure relates to electronic computing devices, and moreparticularly, to accessibility aids for users of electronic computingdevices.

BACKGROUND

Electronic computing devices such as tablets, e-readers, mobile phones,smart phones and personal digital assistants (PDAs) are commonly used toprovide a user with both consumable and non-consumable content. Examplesof consumable content include e-books, webpages, images, videos andmaps; examples of non-consumable content include menus, settings, icons,control buttons and scroll bars. Such electronic devices typicallyinclude a user interface that allows a user to interact with the device,its applications and its content. For example, the user interface mayinclude a touch screen display and/or one or more displayed labels thatcorrespond to hardware controls associated with the device. Atouchscreen display may or may not be backlit, and may be implementedfor instance with a light-emitting diode (LED) screen or anelectrophoretic display.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1a-b illustrate an example computing device including a screenprotector configured in accordance with an embodiment of the presentinvention.

FIG. 1c illustrates a block diagram of the computing device of FIGS.1a-b , configured in accordance with an embodiment of the presentinvention.

FIG. 1d illustrates a block diagram of a communication system includingthe computing device of FIGS. 1a-c , configured in accordance with anembodiment of the present invention.

FIG. 2 illustrates a screen protector configured in accordance with anembodiment of the present invention.

FIG. 3 illustrates an example computing device including a screenprotector configured in accordance with another embodiment of thepresent invention.

FIGS. 4a-c illustrate an example computing device configured withlist-based user interface mode, in accordance with an embodiment of thepresent invention.

FIG. 5 illustrates a method of providing special accessibility to animpaired user of a computing device, in accordance with an embodiment ofthe present invention.

DETAILED DESCRIPTION

A simplified user interface (UI) mode of operation is provided, wherecomplex user interface elements are replaced with simpler ones. Forexample, in one such embodiment, the simplified UI mode can beinitiated, configured, or otherwise triggered when the device is placedinto accessibility mode, for instance when setting up the device for thefirst time (out-of-box), or through the device's settings controls.Alternatively, the computing device may have a separate simplified UImode, either as a sub-mode of accessibility or as a distinct feature onits own. The simplified UI mode places information in a format which canbe readily navigated by means of gesture-invoked audible prompts. In onesuch embodiment, content, functions, and/or other selectable items onthe home screen of the user's device (or from the main panels of thedevice) are assembled into a one-dimensional list. In some cases, thesimplified UI mode can be configured to receive a parsing gesture thatcauses an item of the list to be aurally presented to the user, and aselection gesture to select the last aurally presented item. In onespecific such example case, the location of the parsing/select gesturescan be anywhere on the touch sensitive surface and need not necessarilybe on or otherwise near the presented list. The simplified UI mode maybe used in conjunction with a screen protector configured with tactileaids for users with impaired vision. The screen protector can be placedon the display screen of a computing device to further enhance theout-of-box experience for vision-impaired users and/or guide the userduring subsequent use of the device.

General Overview

Presently, electronic computing devices support accessibility featuresfor users with disabilities. For example, a computing device may featurea selectable mode where the text labels on screen controls can be spokenaloud to the user. However, there still remain various unresolvedproblems associated with such modes. For instance, currently availableaccessibility techniques do not address the initial process of poweringup, configuring, and enabling the accessibility features. Some existingsolutions offer printed initial configuration instructions on screenprotectors, but such solutions are not workable for the vision-impaired.Other existing solutions implicate a degree of complexity effectivelyrendering them impractical for many users. Moreover, vision-impairedusers may further struggle with finding touch screen controls in a richuser interface, which may feature controls placed on the screen in anirregular or otherwise inconsistent fashion, or placed on sliding panels(such as the home screen of devices using the Android platform). Forinstance, a vision-impaired user cannot visually locate or otherwisebenefit from an icon or other such user-selectable items (e.g.,shortcuts to books or music, and a clock) after those icons/itemsvariously change position on a home screen of a given computing device.Adding to the complexity, the home screen itself may be scrollable orpannable.

Thus, and in accordance with an embodiment of the present invention, asimplified UI mode of operation is provided, where complex userinterface elements are replaced with simpler ones. For example, in onesuch embodiment, the simplified UI mode can be initiated, configured, orotherwise triggered when the device is placed into accessibility mode,for instance when setting up the device for the first time (out-of-box),or through the device's settings controls. Alternatively, the computingdevice may have a separate simplified UI mode, either as a sub-mode ofaccessibility or as a distinct feature on its own. The simplified UImode places information in a format which can be readily navigated bymeans of gesture-invoked audible prompts. In one such embodiment,content, functions, and/or other selectable items on the home screen ofthe user's device (or from the main panels of the device) are assembledinto a one-dimensional list.

In some cases, the simplified UI mode may be further configured toreceive a vertical drag gesture that causes each item of the list to beaurally presented to the user as the drag gesture progresses downward.In a more general sense, the simplified UI mode can be configured toreceive a parsing gesture (e.g., downward swipe gesture) that causes anitem of the list to be aurally presented to the user, and a selectiongesture (e.g., release of the drag gesture or a two-finger tap gesture)to select the last aurally presented item. Numerous other suchtouch-based or other suitable parsing/selection gesture schemes will beapparent in light of this disclosure. In one specific exampleembodiment, the location of the parsing/select gestures can be anywhereon the touch sensitive surface and need not necessarily be on orotherwise near the presented list.

In some embodiments, the simplified UI mode is used in conjunction witha screen protector that is provided with tactile aids for users withimpaired vision. The screen protector can be placed on the displayscreen of a computing device, such as a tablet or smartphone or othermobile computing device, to further enhance the out-of-box experiencefor vision-impaired users. For example, the screen protector can beplaced on the device during the manufacturing and packaging process, andconfigured to be tactilely-informative about how to activate specialaccessibility features (such as the simplified UI mode) of the deviceand/or how to proceed with initial set-up and configuration of thedevice.

In one example embodiment, the screen protector includes brailleinstructions for activating a special accessibility mode thatfacilitates further use of the device by a person with vision impairment(e.g., blindness or diminished ability to see). In one such case, thescreen protector further includes a raised or embossed arrow or othertactile aid that effectively points from the braille instruction to alocation of a user interface (UI) control feature that can be tapped,pressed or otherwise engaged to initiate the special accessibility modeor other desired function. Thus, the user can read the braille messageand thereby be instructed to follow the raised arrow (or other tactilelocationing aid) to a location on the touch screen where the user canthen initiate a specified function or mode.

For instance, the braille message may instruct the user to follow thetactile locationing aid from the braille message to a location on thedevice where the user can provide a press-and-hold touch or a swipegesture at the target location designated by the tactile aid so as toengage a special accessibility mode that aurally presents subsequentinstructions and guidance to the vision-impaired user. In some suchcases, the braille message may further include instructions as to whattype of touch or gesture must be provided to initiate the mode, such asa two-finger press-and-hold of 10 seconds, or a V-shaped gesture (forvoice). Numerous engagement mechanisms can be used.

In another embodiment, the braille message may instruct the user tofollow the tactile locationing aid from the braille message to alocation on the device where the user can engage a physical button orother UI control feature so as to initiate the special accessibilitymode. Again, the braille message may include instructions as to how theuser should engage that physical UI control feature to initiate themode, such as a press-and-hold of 5 to 10 seconds on the home button orthe volume-up button, for instance. As will be appreciated in light ofthis disclosure, the techniques provided herein can be used to initiateother functions as well. For example, the braille message may instructthe user to follow the tactile locationing aid from the braille messageto a location on the device where the user can engage a virtual orphysical button so as to increase the volume or some other desiredfunction. Likewise, the braille or otherwise tactile instructions mayinclude information that instructs the user on, for example, how toremove the screen protector, how to turn on the device, how to connectperipheral devices such as braille keyboards or displays, or otherwiseprovide instruction/information that will facilitate use of the device.

In some embodiments, the location of the UI control feature to beengaged by the user can be smooth to the touch, and the tactile aid ofthe screen protector effectively leads to and highlights that locationfor the user (e.g., with a raised arrow head pointing at the location,or a raised circle or square around the location). Note that sightedusers may also see the target UI control feature in some cases, while inother embodiments there may be nothing actually displayed at thatlocation for a sighted user to see (an active touch spot that is scannedfor user input but that has no corresponding visual icon or controlfeature). Note that the screen protector can remain on the device afterinitial set-up and device configuration to continue to identity thetouch location of various functions (e.g., launch browser, send message,etc). Further note that the screen protector may include textualinstructions for sighted users. These textual instructions may be in thesame position as the tactile instructions, since they may be readablethrough the tactile.

In other embodiments, the location of the UI control feature of thecomputing device may include a raised element (and/or a depressedelement, as the case may be) that allows the user to further tactilelyconfirm that he/she has located the proper UI control feature. Thedevice may have a combination of smooth and/or tactile UI controlfeatures having locations identified or otherwise accentuated by tactileaids of the screen protector, in accordance with some embodiments.

In some embodiments, the UI control feature identified with tactileaid(s) may be, for example, an icon or a virtual button, a physical homeor power button, a volume button, or any other virtual or physical UIcontrol feature that can be engaged to facilitate a vision-impaireduser's out-of-box experience and/or continued use of the computingdevice. As previously explained, no visible UI control feature isnecessary, so long as the touch sensitive surface can detect the touchin the target location. Depending on the touch sensitive surfacetechnology, the touch may be directly on the surface or hovering a shortdistance (e.g., a few centimeters) over the surface. In any such cases,once the vision-impaired user has engaged a special accessibility modewith the aid of the tactilely informative screen protector, the user mayreceive verbal instructions going forward so as to allow the user tosuccessfully use the device.

Computing Device Architecture

FIGS. 1a-b illustrate an example computing device including a screenprotector configured in accordance with an embodiment of the presentinvention. The device could be, for example, a tablet such as the NOOK®Tablet or NOOK® eReader by Barnes & Noble. In a more general sense, thedevice may be any electronic device having capability for displayingcontent to a user, such as a mobile phone or mobile computing devicesuch as a tablet or laptop, a desktop computing system, a television, asmart display screen, or any other device having a touch screen display.As will be appreciated, the claimed invention is not intended to belimited to any particular kind or type of electronic device.

As can be seen with this example configuration, the device comprises ahousing, a touch screen display, and a screen protector provided overthat touch screen display. The housing includes a number of hardwarefeatures such as a grommet, a speaker, a power button, and a homebutton. The grommet can be used, for example, to stow or otherwisesecure the device in a notebook, bag or case. The speaker can be used toaurally present content and/or instructive information (such as aurallypresented prompts provided during an accessibility mode) to the user.The touch screen display can be used in conjunction with a touch-baseduser interface (UI). One example touch-based UI includes a quicknavigation menu or tool bar having a number of user-selectablecategories (e.g., Home, Library, Shop, Search, and Settings) so as toprovide quick access to various features of the device. The touch-basedUI may further include other features such as a status bar that includesone or more icons (e.g., a wireless network icon), a battery indicator,and a clock, to name a few examples. Other embodiments may have fewer oradditional UI touch screen controls and features, or different UI touchscreen controls and features altogether, depending on the targetapplication of the device. Any such general UI controls and features canbe implemented using any suitable conventional or custom technology, aswill be appreciated.

The power button can be used to turn the device on and off, and may beused in conjunction with a touch-based UI control feature that allowsthe user to confirm a given power transition action request (e.g., suchas a slide bar or tap point graphic to turn power off). The home buttoncan be a virtual or physical press-button, and may be used in variousways. In one example embodiment, when the device is awake and in use,tapping the home button may display or otherwise present a quicknavigation menu that provides quick access to various features of thedevice. The home button may further control other functionality, forexample, if the user presses and holds the home button. For instance, anexample such push-and-hold function could engage a special accessibilitymode (if held for 5 to 10 seconds) or a power conservation mode (if heldfor greater than 10 seconds). The special accessibility mode can beinvoked, for example, by a vision-impaired user to provide access to auser interface that is more user friendly, and the power conservationmode can be invoked to put the device to sleep or into an otherwiselower power consumption mode for an anticipated period of non-use. Thehome button may also be configured to cease an active function that iscurrently executing on the device, such as an accessibility mode orsub-mode thereof as variously described herein. Thus, in such an exampleembodiment, the home button may be associated with and control differentand unrelated actions: 1) show or otherwise present the quick navigationmenu; 2) exit a given mode of operation; and 3) put the device to sleep.Numerous other configurations and variations will be apparent in lightof this disclosure, and the claimed invention is not intended to belimited to any particular set of virtual buttons, hardware buttons orother UI control features, or device form factor.

As can be seen, the screen protector is provided over the touch screendisplay and includes a number of tactile aids to assist vision-impairedusers, and optionally includes textual instructions that may be usefulfor sighted users. As can be seen in this example embodiment, thetactile aids include three braille instructions/messages and two tactilelocationing aids. One of the locationing aids tactilely identifies thelocation of the power button and the other locationing aid tactilelyidentifies the location of the home button. Note that such tactilelocationing aids are particularly helpful in locating virtual UI controlfeatures that otherwise have no texture that might be detectable bytouch, but can also be helpful in distinguishing between multiplephysical UI control features. The screen protector will be discussed infurther detail with reference to FIG. 2.

As will be appreciated, the various UI control features and sub-menusdisplayed to the user are implemented as UI touch screen controls inthis example embodiment. Such UI touch screen controls can be programmedor otherwise configured using any number of conventional or customtechnologies. In general, the touch screen translates the user touch ina given location into an electrical signal which is then received andprocessed by the underlying operating system (OS) and circuitry(processor, etc). Additional example details of the underlying OS andcircuitry in accordance with some embodiments will be discussed in turnwith reference to FIG. 1 c.

FIG. 1c illustrates a block diagram of an electronic device configuredin accordance with an embodiment of the present invention. As can beseen, this example device includes a processor, memory (e.g., RAM and/orROM for processor workspace and storage), additional storage/memory(e.g., for content), a communications module, a touch screen, and anaudio module. A communications bus and interconnect is also provided toallow inter-device communication. Other typical componentry andfunctionality not reflected in the block diagram will be apparent (e.g.,battery, co-processor, etc). Further note that although a touch screendisplay is provided, other embodiments may include a non-touch screenand a touch sensitive surface such as a track pad, or a touch sensitivehousing configured with one or more acoustic sensors, etc. In any suchcases, the touch sensitive surface is generally capable of translating auser's physical contact with the surface into an electronic signal thatcan be manipulated or otherwise used to trigger a specific userinterface action, such as those provided herein. The principles providedherein equally apply to any such touch sensitive devices. For ease ofdescription, examples are provided with touch screen technology.

In this example embodiment, the memory includes a number of modulesstored therein that can be accessed and executed by the processor(and/or a co-processor). The modules include an operating system (OS), auser interface (UI), and a power conservation routine (Power). Themodules can be implemented, for example, in any suitable programminglanguage (e.g., C, C++, objective C, JavaScript, custom or proprietaryinstruction sets, etc), and encoded on the memory (any suitablenon-transient machine readable medium), that when executed by theprocessor (and/or co-processors), carries out the functionality of thedevice including a UI having an accessibility mode as described herein.Other embodiments can be implemented, for instance, with gate-levellogic or an application-specific integrated circuit (ASIC) or chip setor other such purpose built logic, or a microcontroller havinginput/output capability (e.g., inputs for receiving user inputs andoutputs for directing other components) and a number of embeddedroutines for carrying out the device functionality. In short, thefunctional modules can be implemented in hardware, software, firmware,or a combination thereof.

The processor can be any suitable processor (e.g., Texas InstrumentsOMAP4, dual-core ARM Cortex-A9, 1.5 GHz), and may include one or moreco-processors or controllers to assist in device control. In thisexample case, the processor receives input from the user, includinginput from or otherwise derived from the power button and the homebutton. The processor can also have a direct connection to a battery sothat it can perform base level tasks even during sleep or low powermodes. The memory (e.g., for processor workspace and executable filestorage) can be any suitable type of memory and size (e.g., 256 or 512Mbytes SDRAM), and in other embodiments may be implemented withnon-volatile memory or a combination of non-volatile and volatile memorytechnologies. The storage (e.g., for storing consumable content and userfiles) can also be implemented with any suitable memory and size (e.g.,2 GBytes of flash memory).

The display can be implemented, for example, with a 7 to 9 inch1920×1280 IPS LCD touchscreen touch screen, or any other suitabledisplay and touch screen interface technology. As will be appreciated inlight of this disclosure, the display may further include touchdetection technology and can be any display that is configured withtouch detecting technologies, whether capacitive, resistive, acoustic,active-stylus, and/or other input detecting technology. For example, insome embodiments, the screen display can be layered above input sensors,such as a capacitive sensor grid for passive touch-based input via afinger or stylus in the case of a so-called in-plane switching (IPS)panel, or an electro-magnetic resonance (EMR) sensor grid. In someembodiments, the touch sensitive display can be configured with a purelycapacitive sensor, while in other embodiments the display may beconfigured to provide a hybrid mode that allows for both capacitiveinput and EMR input, for example. In still other embodiments, the touchsensitive display is configured with only an active stylus sensor.Numerous touch screen display configurations can be implemented usingany number of known or proprietary screen based input detectingtechnologies. In any such embodiments, the display may further include acontroller configured to selectively scan the touch sensitive displayand/or selectively report touch inputs detected directly on or otherwisesufficiently proximate to (e.g., within a few centimeters, or otherwisesufficiently close so as to allow detection) the touch sensitivedisplay. In one example embodiment, a touch input can be provided by astylus or finger(s) hovering some distance above the touch sensitivesurface (e.g., one to a few centimeters above the surface, or evenfarther, depending on the sensing technology deployed in the touchsensitive display surface), but nonetheless triggering a response at thedevice just as if direct contact were provided directly on the display.

The communications module can be, for instance, any suitable 802.11b/g/nWLAN chip or chip set, which allows for connection to a local network sothat content can be downloaded to the device from a remote location(e.g., content provider, etc, depending on the application of thedisplay device). In some specific example embodiments, the devicehousing that contains all the various componentry measures about 7″ to9″ high by about 5″ to 6″ wide by about 0.5″ thick, and weighs about 7to 8 ounces. Any number of suitable form factors can be used, dependingon the target application (e.g., laptop, desktop, mobile phone, etc).The device may be smaller, for example, for smartphone and tabletapplications and larger for smart computer monitor applications.

The operating system (OS) module can be implemented with any suitableOS, but in some example embodiments is implemented with Google AndroidOS or Linux OS or Microsoft OS or Apple OS. As will be appreciated inlight of this disclosure, the techniques provided herein can beimplemented on any such platforms. The power management (Power) modulecan be configured, for example, to automatically transition the deviceto a low power consumption or sleep mode after a period of non-use. Awake-up from that sleep mode can be achieved, for example, by a physicalbutton press and/or a touch screen swipe or other action. The userinterface (UI) module can be, for example, based on touch screentechnology and the various example screen shots and use case scenariosshown in FIGS. 1a , 2, 3, and 4 a-c, in conjunction with theaccessibility mode methodologies demonstrated in FIG. 5, which will bediscussed in turn. The audio module can be used in conjunction with thespeaker and configured, for example, to aurally present initialconfiguration or use instructions or selected content, if preferred bythe user (e.g., as part of a special accessibility mode suitable forvision-impaired users). Numerous commercially available text-to-speechmodules can be used, such as Verbose text-to-speech software by NCHSoftware. In some example cases, if additional space is desired, forexample, to store digital books or other content and media, storage canbe expanded via a microSD card or other suitable memory expansiontechnology (e.g., 32 GBytes, or higher). Further note that although atouch screen display is provided, other embodiments may include anon-touch screen and a touch sensitive surface such as a track pad, or atouch sensitive housing configured with one or more acoustic sensors,etc.

FIG. 1d illustrates a block diagram of a communication system configuredin accordance with an embodiment of the present invention. As can beseen, the system generally includes an electronic device (such as theone shown in FIGS. 1a-c ) that is capable of communicating with anapplication server via a network/cloud. In this example embodiment, theelectronic device may be, for example, an eBook reader, a mobile cellphone, a laptop, a tablet, desktop, or any other touch sensitivecomputing device. The network/cloud may be a public and/or privatenetwork, such as a private local area network operatively coupled to awide area network such as the Internet. In this example embodiment, theserver may be programmed or otherwise configured to receive contentrequests from a user via the device and to respond to those requests byproviding the user with requested or otherwise recommended content. Insome such embodiments, the server is configured to remotely provision anaccessibility mode or sub-mode to the device (e.g., via JavaScript orother browser based technology configured to provision list-basedcontent that can be aurally presented in response to a vertical draggesture on the touch screen display). In one such case, the URL of theapplication server (or other location identifier associated with theserver) can be brought to the user's attention via a tactile aidprovided on the screen protector. Thus, when the user touches orotherwise selects the URL as directed and guided by the tactile aid, thedevice will issue a request to the server to issue content in a spokenor otherwise aurally presented format. In other embodiments, portions ofthe accessibility methodology are executed on the server and otherportions of the methodology are executed on the device. Numerousserver-side/client-side execution schemes can be implemented tofacilitate a content selecting mode in accordance with an embodiment, aswill be apparent in light of this disclosure.

Screen Protector

FIG. 2 illustrates a screen protector configured in accordance with anembodiment of the present invention. As can be seen, the screenprotector is configured with a number of tactile aids includinginstructions or messages in braille and embossed or raised graphics. Ascan be seen in this example case, the graphics include an arrow pointingfrom a given braille message to the power switch on the side of thedevice. In one such example case, the braille message might be, forinstance, “Power switch is located here—follow raised arrow.” Thegraphics also include a raised line provided from another given braillemessage to a circle around the home button. In one such example case,the braille message might be, for instance, “press and hold for 10seconds the home button within the raised circle at the end of this lineto enter special accessibility mode.” Numerous other tactile aids willbe apparent in light of this disclosure (e.g., a single line or multiplelines and arrow-heads/circles/squares pointing to or otherwiseidentifying the location of device features, such as volume controls,headphone jacks, or other aids).

As will be further appreciated, the braille messages may include anytype of helpful instructions or information that may improve the userexperience of a vision-impaired user of the device. For instance, agiven braille message may include instructions on how to remove thescreen protector, how to turn on the device, how to activate specialaccessibility features of the device, how to connect peripheral devicessuch as braille keyboards or displays, how to initiate auralpresentation of device configuration routine, how to access the quicklaunch menu of the device so as to access the control settings or otherfeature, how to access technical support, how to access forums suitablefor similarly situated users (e.g., a blog or forum developed by and forvision-impaired users), etc. As can be further seen, such an enhancedscreen protector may also include textual instructions for sightedusers. In one such embodiment, these textual instructions may be in thesame position as the tactile instructions, since they may be readablethrough the tactile aids.

The screen protector can be implemented with any number of suitablematerials, such as clear plastic film or velum or any material uponwhich tactile aids can be embossed or otherwise provisioned (e.g.,paper, cardboard, foil, rigid plastic, glass, metal, ceramic, etc). Thescreen protector may be left attached to the device, or may beremoved/disposable once the user has used the protector to learn aboutthe accessibility mode of the device. In the disposable case, the usercan peel-off or otherwise remove and discard the screen protector, inaccordance with some embodiments. The screen protector may betransparent, but need not be, depending on the type of usersanticipated. In any such cases, conventional embossing and/or printingtechniques can be used to impart the tactile aids to the screenprotector (e.g., pressure-based imprinting, vacuum-based imprinting,lithography, injection molding, etching, laser printing for braille,etc). The screen protector can then be fixed to or otherwise secured onthe display of the device. Note that, in some cases, the protector canbe applied to the display screen early in the manufacturing process, soas to protect the display during subsequent manufacturing processes.Alternatively, the protector can be applied to the display screen at theend of manufacturing process prior to packaging. Alternatively, theprotector can be purchased or otherwise acquired separately from thedevice and applied to the screen post-purchase of the device.

FIG. 3 depicts an embodiment wherein the screen protector with tactileaids covers only a portion of the screen and allows the user to haveaccess to the rest of the display. Such an embodiment may be useful, forexample, for configurations where the user can enter the accessibilitymode by pressing and holding a virtual home button or icon (e.g., asdirected by the braille message and wherein the virtual home button oricon is within a raised circle or square at the end of a raised linefrom that runs from the braille message to the location of the virtualbutton/icon, such as shown in the example of FIG. 3), and still directlyaccess the touch screen so as to provide touches and gestures tointeract with the device. In one such case, once the accessibility modeis invoked, the location of the touches/gestures on the touch screen canbe independent of the location of the content or other items beingselected. In other words, the user need not have to see the selectableelements to make selections or otherwise interact with the device.

For instance, once invoked the accessibility mode of the device may beprogrammed or otherwise configured to provide all of the content andother user-selectable items on the home screen or panels, or somesub-set thereof based on for example user-selection or configuration, ina one-dimensional list. Subsequently, any drag gestures, taps, or othertouches received anywhere on (or sufficiently proximate to) the touchscreen can be used to cause the device to aurally present each item onthe list in sequential order so that the presented item can be selectedby the user. For example, the accessibility mode of the device may beconfigured to, in response to a vertical drag gesture (anywhere on touchscreen), cause each item on the list to be aurally presented in sequence(e.g., from top to bottom), and in response to a subsequent screen tap(anywhere on touch screen) after a given aural presentation, causeselection of that aurally presented item. In this way, the user need notbe able to see the content (or even the list) on the home screen orpanels (or other user screens). Rather, once the accessibility mode isactivated, the user can interact with the device via the simplifiedlist-based UI and receive aural instructions and prompts to facilitateuse of device and make content selections and otherwise direct thedevice by screen taps when appropriate, in accordance with an embodimentof the present invention. Additional details of a simplified UI will beprovided with further reference to FIGS. 4a-c and 5.

Numerous other configurations of screen protectors that partially coverthe underlying display screen will be apparent in light of thisdisclosure. For instance, in another embodiment, the screen protectormay be configured with various tactile aids as variously discussedherein and also include an elongated cut-out or window where swipe andtap gestures can be provided. In one such example embodiment, once inthe accessibility mode, the scan controller of the device can beconfigured to only scan and/or report touches that are provided in thatwindow. Such selective scanning/reporting can be used to save on batterypower, which is particularly helpful for mobile devices. Note that thegesture window may also be associated with a braille message thatexplains its purpose, and is effectively tactile in nature due to thedetectable edge defining the perimeter of the window.

Simplified UI

FIGS. 4a-c illustrate an example computing device configured with asimplified UI mode that includes a list-based selection mechanism, inaccordance with an embodiment of the present invention. Note that theprevious discussion with respect to FIGS. 1a-c is equally applicablehere, although note that the simplified UI mode need not be used inconjunction with the screen protector. This simplified UI mode can beused to assist users with access and use of an electronic device, byeffectively replacing complex user interface elements with simpler ones,and in one specific example case, by placing information in a listformat which can be easily navigated by means of gesture-invoked audibleprompts. In one embodiment, the simplified UI mode can be initiated,configured, or triggered, in response to the device being placed intothe special accessibility mode as directed by the screen protector(e.g., “press and hold point at end of raised arrow to invokeaccessibility mode”), for example, when setting up the device for thefirst time (out-of-box), or through the device's control settings.Alternatively, the simplified UI mode may be a sub-mode of the specialaccessibility mode, or a distinct feature that can be providedindependently of any other modes or features of the device. To this endand as will be appreciated in light of this disclosure, the simplifiedUI has a usefulness that is independent of the screen protector.

As can be seen, FIG. 4a illustrates an example home screen of the devicethat includes multiple application icons and other items arranged in arandom pattern on the screen. The application icons may include, forinstance, an email application icon, a phone application icon, asettings icon, a game icon, and/or any other icons that can be tapped orotherwise selected to launch a corresponding application or function.Some examples of other items include, for instance, shortcuts to booksor music or other consumable content, and a clock shown at the topright. Adding to the complexity of this UI arrangement is that the homescreen may be scrollable or pannable, or include multiple panels thatcan be navigated with horizontal swiping or flicking gestures. For avision-impaired user, such randomness and lack of consistentpresentation can significantly impede or otherwise preclude use of thedevice. A user with cognitive disability may experience a similardisadvantage.

FIG. 4b illustrates an example simplified UI mode that includes aone-dimensional list that can be more easily navigated and interactedwith, in accordance with an embodiment of the present invention. As canbe seen, the one-dimensional list includes the various application iconsand other items that were randomly positioned on the home screen shownin FIG. 4a . The simplified UI mode is programmed or otherwiseconfigured to present these randomly positioned icons/items in listformat. In one such embodiment, the simplified UI mode is furtherconfigured to, in response to a user's swipe or tap on the touch screen,aurally present each item on the list in a sequential fashion.

For example, in response to a first downward vertical swipe gesture thesimplified UI mode can be configured to aurally present “Application 1”,and in response to a second downward vertical swipe the simplified UImode can be configured to aurally present “Application 2”, and so on.Should the user wish to select the aurally presented item, the user canprovide a screen tap. Thus, the user can use swipes to effectivelynavigate to the desired item on the list, and then select that item witha tap. The user can thus launch applications and access content asdesired.

As previously explained, once the simplified UI mode is invoked, thelocation of the touches/gestures on the touch screen can be independentof the location of the content or other items being selected. In otherwords, the user need not have to see the selectable elements to makeselections or otherwise interact with the presented list. For instance,and as shown in FIG. 4c , a downward swipe gesture can be provideddirectly on or close to the list, but can also be provided elsewhere onthe screen (such as the lower right corner, as further shown in FIG. 4c). To this end, the simplified UI mode can be configured to, onceinvoked, direct the display controller to only report specific gesturesthat are used for navigating the list and making selections, or to exitthe simplified UI mode, in accordance with an embodiment. Alternatively,the simplified UI mode can be configured to allow all contacts to bereported, but to respond to only the specific gestures allowed (e.g.,downward two finger swipe to parse list via sequential auralpresentation one item at a time, and two finger tap to select lastaurally presented item of the list) and ignore all other touches. Suchselective touch response may further enhance the user experience.

As will be appreciated in light of this disclosure, different gesturesor touches by the user can be used to invoke different responses by thesimplified UI mode. For example, note that the time is provided in asomewhat separate fashion from the rest of the listed items. In one suchembodiment, in response to a two-finger downward vertical swipe gesturethe simplified UI mode can be configured to aurally present the currenttime (e.g., “the time is 7:43 am”), and in response to a one-fingerdownward vertical swipe gesture the simplified UI mode can be configuredto aurally present each item in the list in a sequential fashion aspreviously explained. Also, the selection of an aurally presented itemcan be made, for instance, with a two-finger tap, so as to distinguish alist-item selection gesture from some other command (such as a global“go-back” one-finger tap command). Numerous other such touch-basednavigation schemes can be used.

In some embodiments, the simplified UI mode can be used in conjunctionwith a screen protector as previously described, wherein the list ofselectable items can be presented within a cut-out or window of thescreen protector. As previously explained, the scan controller of thedevice's display assembly can be configured to only scan and/or reporttouches that are provided within that window. Alternatively, or inaddition, the screen protector may direct a vision-impaired user on howto invoke the simplified UI mode, so as to facilitate use of that deviceby the user.

In some embodiments, panning can be disabled in the simplified UI modeas can any panel-based navigation involving multiple screens, and all ora subset of items that would have been visually presented on thosevarious screens are presented in list form as depicted in FIG. 4b(contrasted with FIG. 4a for a random home screen). In some cases, theuser may select the items to be provided in the list and/or the list mayinclude a number of default or otherwise hard-coded items that areautomatically put in the list. For instance, during initialconfiguration, the simplified UI mode (or other accessibility mode) canbe configured to aurally present a master list of available items to theuser and the user can add any aurally presented item to the list bysaying “yes” or “add to list” (or some other comparable voice command),or by tapping the touch screen twice or with a 2-finger tap. Conversely,excluding items from the list can be done, for instance, by saying, “no”or a 1-finger tap.

In some embodiments, the simplified UI mode is further configured toprioritize the list based on user-selection patterns and historicalusage. Thus, items that are more frequently selected by the user can bemoved toward the top of the list and items that are less frequentlyselected by the user can be moved toward the bottom of the list. Usagestatistics can be maintained, for instance, in one or morevariables/counters maintained by the simplified UI mode.

In some cases, audible navigation may be activated separately, and neednot be configured in all embodiments. For instance, the simplified UImode having a list-based interface with or without an audible navigationfeature may be helpful to sighted users with cognitive impairments. Ifaudio feedback is enabled, a user may one or more fingers down the listto hear each item aurally presented in turn. For example, in oneembodiment, the name of a listed application can be aurally presented tothe user, the title and/or description of listed consumable content canbe aurally presented to the user, or in the case of a listedinformational function such as a time function or a temperaturefunction, the current time of day or the temperature can be aurallypresented to the user. For content items, a snippet may be provided tothe user, such as 10 seconds of a listed music file or playlist or thefirst few sentences of an eBook. Alternatively, or in addition,non-verbal sounds can be used, for example, so long as the user canassociate those sounds with a listed piece of content or application orother selectable item of the list.

As will be appreciated, the simplified UI mode can be applied across awide range of applications in a similar fashion, thus enhancingaccessibility across the device experience. Note that the device may ormay not include a screen protector, such as the one shown in FIG. 1a , 2or 3, although any suitable screen protector configuration havingtactile aids embossed thereon can be used. If the screen protector isincluded, it may be fixed to the device or removable, as previouslyexplained.

Methodology

FIG. 5 illustrates a method of providing special accessibility to animpaired user of a computing device, in accordance with anotherembodiment of the present invention. This example methodology may beimplemented, for instance, by the UI module of the touch sensitivedevice shown in FIG. 1c , or the touch sensitive device shown in FIG. 1d(e.g., with the UI provisioned to the client by the server). To thisend, the UI can be implemented in software, hardware, firmware, or anycombination thereof, as will be appreciated in light of this disclosure.

As can be seen, the method may be used in conjunction with a screenprotector configured with tactile aids, but may also be usedindependently of (and without) such a screen protector. As can befurther seen, this example embodiment includes sensing a user's input bya touch sensitive surface. In general, any touch sensitive device may beused to detect contact with it by one or more fingers and/or styluses.As soon as the user begins to drag or otherwise move the contact points,the UI code (and/or hardware) can assume a drag gesture has been engagedand track the path of each contact point with respect to any fixed pointwithin the touch surface until the user stops engaging the touchsensitive surface. The release point can also be captured by the UI asit may be used to commit the action started when the user pressed on thetouch sensitive surface. In a similar fashion, if the user releases holdwithout moving the contact point, a press or press-and-hold command maybe assumed depending on the amount of time the user was continuallypressing on the touch sensitive surface. These main detections can beused in various ways to implement UI functionality. In still otherembodiments, an accessibility mode configured with a list-basedpresentation that can be aurally presented to the user as describedherein can be used on a system that includes any type of user inputmechanism, such as a mouse, joystick, or other suitable user inputdevice, wherein input provided by the given input device causes adetectable and actionable signal that can be used to invoke and/orotherwise direct the methodology.

In this example case, the method includes detecting 501 user contact atthe touch sensitive interface. In general, the touch monitoring iseffectively continuous. The method continues with determining 503 if thecontact indicates that the accessibility mode is desired. As previouslyexplained, the touch that invokes the accessibility mode can beprovided, for example at a specific location on the touch screen and/oron a specific UI control feature. In some such embodiments, thatspecific location may be highlighted by tactile aids of a screenprotector that further includes a braille message to the user explaininghow to invoke the accessibility mode. In any case, the determining 503may include selectively scanning and reporting touches (direct orotherwise sufficiently proximate) at that location. Further recall thatthe location may be visually identified with a marker (e.g., icon orswitch) or not.

If it is determined that the accessibility mode is not desired, themethod continues with reviewing 504 the contact for some other UIrequest. However, if it is determined that the accessibility mode isdesired, the method continues with activating 505 the accessibility modeto direct initial configuration of device. Thus, a special mode ofoperation is invoked to allow an impaired user to continue use of thedevice. The user may be, for instance, vision-impaired and/orcognitive-impaired. In some example embodiments, this accessibility modeof operation is configured to aurally present information and choices tothe user during initial configuration of the device, thereby providingan enhanced out-of-box experience for the impaired user. As will beappreciated in light of this disclosure, the accessibility mode mayfurther include (or alternatively include) a simplified user interfacethat is more accommodating of the user's impairment.

The method of this example embodiment continues with determining 507 ifa list-based user interface mode should be initiated. In some examplecases, if the user has provided the initial touch (or other user input)at 503, then this list-based UI mode can be automatically invoked aspart of the overall accessibility mode. In other embodiments, thelist-based UI mode is invoked separately or not at all, if so desired.For instance, in some example embodiments, the methodology comprisesinvoking an accessibility mode in response to receiving user input asdirected via a tactically-enhanced screen protector, without providingany list-based UI mode of operation.

If it is determined at 507 that a list-based user interface mode shouldnot be initiated, then the methodology concludes and continues tomonitor for other touches (or other user input). On the other hand, ifit is determined at 507 that a list-based user interface mode should beinitiated, then the methodology continues with disabling 509 panningand/or panel-based UI functionality. As previously explained, navigatinga pannable or multi-screen UI presents a particular challenge to someusers, so disabling or otherwise removing such functionality fromconsideration allows for that user to continue using the device in thecontext of a positive user experience.

The method continues with presenting 511 selectable content inlist-form. As previously explained, the content included in the list maybe user-configurable and/or hard-coded, and may further be prioritizedbased on usage history associated with a given user. Note that differentusers of the same device may have different usage statistics, so in somesuch embodiments, a user account can be established so as to allow theaccessibility mode to distinguish between users.

The method continues with aurally presenting 513 each item on the listin a sequential fashion and in response to a parsing gesture (e.g.,vertical drag gesture or three finger tap), and selecting 515 an aurallypresented item in response to a selection gesture (e.g., upon release ofvertical drag gesture or two finger tap). Numerous parsing and selectiongesture schemes can be used as will be appreciated in light of thisdisclosure. As previously explained, the aural presentation may include,for instance, the name of a listed application (e.g., “word processor”or “email”), or the title and author and/or a snippet of listedconsumable content (e.g., “The Catcher in the Rye, J.D. Salinger: ‘Ifyou really want to hear about it, the first thing you'll probably wantto know is where I was born, and what my lousy childhood was like, andhow my parents were occupied and all before they had me, and all thatDavid Copperfield kind of crap, but I don't feel like going into it, ifyou want to know the truth’”), or the result/output of a listed function(e.g., enunciation of current time or temperature). After a selection ismade, the methodology may repeat as desired.

Numerous variations will be apparent in light of this disclosure. Forinstance, one example embodiment of the present invention provides acomputing system. The computing system includes a display for presentingcontent to a user, a processor, and a simplified user interface modeexecutable on the processor and configured to present selectable contentfor display in a list format, wherein that selectable content ispresented for display in a non-list format when the system is not in thesimplified user interface mode. In some cases, the simplified userinterface mode is further configured to aurally present items in thelist in response to a user swipe gesture. In some cases, the simplifieduser interface mode is further configured to disable panning. In somecases, the selectable content in list format comprises user-defineditems. In some cases, the display is a touch screen display. In somecases, the system further includes a screen protector for protecting thedisplay and having one or more tactile aids configured to facilitate useof the system by a vision-impaired user. In some such cases, the one ormore tactile aids include a braille message. In some cases, the braillemessage includes information on how to remove the screen protector fromthe display. In some cases, the braille message includes information onhow to turn on the system. In some cases, the braille message includesinformation on how to activate the simplified user interface mode. Insome cases, the braille message includes information on how to connectperipheral devices that will assist the vision-impaired user in use ofthe system. In some cases, the one or more tactile aids include a raiseddirectional element that identifies a location of a user interfacecontrol feature of the system. In some such cases, the raiseddirectional element includes a raised line that runs from proximate to abraille message to a location of a user interface control feature of thesystem. In some cases, the screen protector is configured to only covera portion of the display. In some cases, the one or more tactile aids ofthe screen protector tactilely indicate how to activate the simplifieduser interface mode.

Another embodiment provides a computing system. In this example case,the system includes a touch screen display for receiving input from auser, a processor, and a simplified user interface mode executable onthe processor and configured to disable panning and present selectablecontent for display in a list format, wherein that selectable content ispresented for display in a non-list format when the system is not in thesimplified user interface mode, and wherein the simplified userinterface mode is further configured to aurally present items in thelist in response to a user parsing gesture. In some such cases, theselectable content in list format comprises user-defined items. In someembodiment, the system further includes a screen protector forprotecting the display and having one or more tactile aids configured tofacilitate use of the system by a vision-impaired user, wherein the oneor more tactile aids tactilely indicate how to activate the simplifieduser interface mode.

Another embodiment provides a computer program product comprising aplurality of instructions non-transiently encoded thereon to facilitateoperation of an electronic device according to a process. The computerprogram product may include one or more computer readable mediums suchas, for example, a hard drive, compact disk, memory stick, server, cachememory, register memory, random access memory, read only memory, flashmemory, or any suitable non-transitory memory that is encoded withinstructions that can be executed by one or more processors, or aplurality or combination of such memories. In this example embodiment,the process is configured to, in a simplified user interface mode of thedevice, present user-selectable content for display in a list format,wherein that selectable content is presented for display in a non-listformat when the device is not in the simplified user interface mode. Theprocess is further configured to aurally present items in the list inresponse to a user parsing gesture. In some cases, in the simplifieduser interface mode, the process may be further configured to disablepanning.

The foregoing description of the embodiments of the invention has beenpresented for the purposes of illustration and description. It is notintended to be exhaustive or to limit the invention to the precise formdisclosed. Many modifications and variations are possible in light ofthis disclosure. It is intended that the scope of the invention belimited not by this detailed description, but rather by the claimsappended hereto.

What is claimed is:
 1. A computing system comprising: a display forpresenting content to a user; a processor; a simplified user interfacemode executable on the processor and configured to present selectablecontent for display in a list format; and a screen protector forprotecting the display and having one or more tactile aids configured tofacilitate use of the computing system by a vision-impaired user;wherein the selectable content is presented for display in a non-listformat when the computing system is not in the simplified user interfacemode; and wherein the one or more tactile aids include at least onebraille message including (a) a braille message that providesinformation on how to remove the screen protector from the display, (b)a braille message that provides information on how to turn on thecomputing system, (c) a braille message that provides information on howto activate the simplified user interface mode, and/or (d) a braillemessage that provides information on how to connect peripheral devicesthat will assist the vision-impaired user in using the computing system.2. The computing system of claim 1, wherein the simplified userinterface mode is further configured to aurally present portions of theselectable content in response to a user swipe gesture.
 3. The computingsystem of claim 1, further comprising a default user interface modeexecutable on the processor and configured to present the selectablecontent in a plurality of panes which are accessed using a panninggesture.
 4. The computing system of claim 1, further comprising adefault user interface mode executable on the processor and configuredto present the selectable content in a plurality of panes which areaccessed using a panning gesture, wherein the simplified user interfacemode is not responsive to the panning gesture.
 5. The computing systemof claim 1, wherein the one or more tactile aids include a braillemessage that provides information on how to activate the simplified userinterface mode.
 6. The computing system of claim 1, wherein the displayis a touch screen display.
 7. The computing system of claim 1, whereinthe one or more tactile aids includes a raised directional element thatidentifies a location of a user interface control feature of thecomputing system.
 8. The computing system of claim 1, wherein: the oneor more tactile aids includes a raised directional element thatidentifies a location of a user interface control feature of thecomputing system; and the raised directional element includes a raisedline that runs from (a) proximate to one of the braille messages to (b)the location of the user interface control feature.
 9. The computingsystem of claim 1, wherein the screen protector is configured to onlycover a portion of the display.
 10. The computing system of claim 1,wherein the one or more tactile aids indicates how to activate thesimplified user interface mode.
 11. A computing system, comprising: adisplay for presenting content to a user; a processor; a default userinterface mode executable on the processor and configured to presentcontent for display in a plurality of panes which are accessed using apanning gesture; and a simplified user interface mode executable on theprocessor and configured to present at least a portion of the contentfor display in a list format; wherein one or more tactile aids indicateshow to activate the simplified user interface mode; wherein the contentis presented for display in a non-list format when the computing systemis in the default user interface mode; and wherein the simplified userinterface mode is not responsive to the panning gesture.
 12. Thecomputing system of claim 11, wherein the content comprises one or moreuser-defined items.
 13. The computing system of claim 11, furthercomprising a screen protector for protecting the display and having oneor more tactile aids configured to facilitate use of the computingsystem by the user.
 14. The computing system of claim 11, furthercomprising a screen protector for protecting the display and having oneor more tactile aids configured to facilitate use of the computingsystem by the user, wherein the one or more tactile aids configured tofacilitate use of the computing system include the one or more tactileaids that indicate how to activate the simplified user interface mode.15. The computing system of claim 11, further comprising a screenprotector for protecting the display and having one or more tactile aidsconfigured to facilitate use of the computing system by the user,wherein the one or more tactile aids include a braille message thatincludes information that includes (a) information on how to remove thescreen protector from the display, (b) information on how to turn on thecomputing system, (c) information on how to activate the simplified userinterface mode, and/or (d) information on how to connect peripheraldevices that will assist the user in using the computing system.
 16. Anon-transitory computer readable medium encoded with instructions that,when executed by at least one processor, cause a control process to becarried out, the control process comprising providing a touch sensitivedisplay that includes a user interface having a simplified userinterface mode in which a plurality of items are arranged in a listdisplayed on the touch sensitive display, wherein the simplified userinterface mode responds to a swipe menu navigation gesture that does nottouch the list and that identifies one of the items by generating afirst audible announcement of the identified item, wherein the swipemenu navigation gesture must be performed multiple times to scrollthrough multiple items listed in the list, wherein the simplified userinterface mode responds to an item selection gesture by selecting theitem that was identified by the swipe menu navigation gesture, andwherein detection, at a location that is anywhere on the touch sensitivedisplay, of the item selection gesture results in a response that isindependent of the location on the touch sensitive display where theitem selection gesture is detected, the location encompassing allportions of the touch sensitive display that are contacted by the itemselection gesture.
 17. The non-transitory computer readable medium ofclaim 16, wherein the touch sensitive display further includes a defaultuser interface mode configured to present the items in a plurality ofpanes which are accessed using a panning gesture.
 18. The non-transitorycomputer readable medium of claim 16, wherein: the touch sensitivedisplay further includes a default user interface mode configured topresent the items in a plurality of panes which are accessed using apanning gesture, and the simplified user interface mode is unresponsiveto the panning gesture.
 19. The non-transitory computer readable mediumof claim 16, wherein the simplified user interface mode is furtherconfigured to aurally present the items in response to the swipe menunavigation gesture.
 20. The non-transitory computer readable medium ofclaim 16, wherein: the swipe menu navigation gesture is a swipinggesture, and the item selection gesture is selected from a groupconsisting of a release of the swiping gesture and a tap gesture.